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This study was conducted in order to compare the 
effects of immediate practice and delayed practice on retention of 
learned rules* Seventh-grade students (N=103) were instructed on 
three rules of operation with exponents by programmed text. These 
subjects were randomly assigned to five treatment groups: (1) no 
practice, (2) one practice trial on the first day, (3) five practice 
trials on the first day, (4) one practice trial on the fifth day, and 
(5) five practice trials on the fifth day. On the twenty-first day of 
the study, all subjects were given a retention test. Findings 
indicated that delayed practice was significantly" more effective than 
immediate practice as a means of providing for retention. Five 
delayed trials were not more effective than one delayed trial, nor 
was immediate practice more effective than no practice. (SD) 
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INTRODUCTION ^ 

Much of what is learned in the classroom is too soon forgotten. 
Pressey, Robinson, and Horrocks (1959) found evidence that as much as 
two-thirds of the concepts learned in high school and college courses 
are forgotten within two years. Numerous other studies conducted in the- 
area of forgetting have yielded results which indicate students forget 
a large proportion of what is learned in the classroom. Among these 
studies are those of Tyler (1933), Layton (1932); Lahey (1941), and 
Sterrett and Davis (1954).* 

Not all types of learned material ^re forgotten to the same degree, 
however. Research indicates that learning which deals with the application 
of rules and principles seems to be retained somewhat better than that which 
deals with factual material. Tyler (1930), for example, in a study of 
retention of information from a high school science class found that, after 
eight months, "...the greatest loss during the year was in information 
about science, whereas there was little or no loss in the ability to 
explain everyday phenomena and the ability to generalize from given facts." 
Other results which point to higher retention of rules and their applica- 
tions, when compared to factual information, can be found in the studies 
of Briggs and Reed (1943), English, Welbom, and Killian (1934), Sterrett 
and Davis (1954) , Freud and Cheronis (1940) . 

Ausubel (1968) also cites evidence indicating that rules and 
their applications are better retained than factual information. In 
addition, he cites evidence that the retention of factual material is 
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improved if the material is presented in a meaningful manner. Both of 
these types of evidence have led Ausubel to suggest that the large 
retention losses found by many studies are not necessarily inevitable 
and that some forgetting is reflective of such factors as rote learning 
of pcorly organized and programmed subject matter, correctable ambiguity 
and confusion in the presentation of ideas, and inadequate pacing and 
review of material . 

STAJEMEilT OF THE PROBLEM 

Learning of rules and principles v/as identified as a particular 
type of learning by Gagne (1972) and classified vn'thin his domains of 
learning as an intellectual skill. It is the retention of these intellec 
tual skills and of rule learning in particular which provides the focus 
for the present study. 

The learning of rules is itself of vast educational importance, 
if for no other reason than that rules make up the bulk of v;hat is 
learned in the schools (Gagne, 1970). It is also of importance that 
rules govern a l?rger class of behaviors and their mastery and continued 
retention enables one to respond properly to various stimulus situations, 

Ausubel (1968) suggests that it is possible to improve retention 
by eliminating. shortcomings in tiie organization, presentation, and review 
of learning material. According to this conception, practice, as a form 
of review, might prove a valuable tool in improviny tha retention of rule 
learning, but all too frequently, practice assignments are based on past 
experience^ the exercises provided in textbooks, considerations pertain- 
ing to the amount of material to be covered, or even whim. It is 

6 



therefore, the purpose of this study to investigate tlie influence of the 
placement and number of practice trials on the retention of rules. When 
"practice" is used in connection v/it.h rule learning, the kind of activity 
referred to is the application of the rule to examples (instances of the 
rule), and a "trial" of practice is an occasiofi. on v/hich a previously 
unencountered instance of the rule is responded to by the learner. 

REVIEW OF THE LITERATURE 

Number of Practice Trials 

Despite its immense practical significance for classroom learning, 
little experimental research has been conducted on the relationship between 
number of practice trials and delayed retention of meaningfully learned 
material. 

Differences of opinion do exists hov/ever, as to whether this 

relationship is such that a larger number of practice trials aid retention, 

or whether, beyond a certain point in the learning process, additional 

amounts of practice have no appreciable effect. Anderson and Faust 

(1973:442-55) and Ausubel (1958:273-89), for example, support the position 

that additional practice has a positive effect on retention. Gagne, on 

the other hand, suggests that, at least in the domain of intellectual skills, 

"...it is not at all clear that the variable of amount of 
initial learning is of such importance. If a concept or 
rule has been completely learned, (in the sense that it 
can be applied to a novel example) it is entirely possible 
that additional practice may have no appreciable effect on 
its retention." (1970:319) 

In the area of information or verbal learning, several studies 

have indicated tlie tendency for additional practice at the time of 



ori.glnal learning to increase delayed retention. (It may be noted, as 
a clarifying point, that "practice" of verbal items or passages refers 
to repetition of the same items.) Gilbert (1957) found that delayed 
retention on tests 15 minutes, one day, and tio days after original 
learning, v/as directly related to degree of overlearning. Similarly/ 
Slamecka (1959) found that delayed recall v/as directly related to 
number of repetitions. 

Other studies of verbal learning, V7hile noting the positive 
effect of increased practice on retention, have also indicated a 
tendency for the learning curves to be negatively accelerated and to 
eventually level off. ilcTavish (1949), for example, shov/ed that the 
first repetition of a film on general science substantially increased 
retention, but that the second and third repetitions added little or 
nothing to the effect of tlie first. Likewise. Rothkopf (1968) found 
that correct responses increased as a function of repeated exposure 
to the passage but that the learning curve v/as negatively accelerated 
and leveled off after to/o inspections. 

Craig, Sternthal, and Olshan (1972) examined the relationship 
betv/een overlearning and the retention of print advertisements. Results 
obtained from the retention scores in this research v/ere not conclusive, 
but overall indications were that some repetition beyond that required 
to learn stimulus materials results in better retention than does 
repeti ti on 'j«st sufficient to insure learning. 

In contrast to those cited above, other studies of information 
learning have failed to show ar\y differences in delayed retention as a 
result of additional practice. One v/ell-knov/n study of this group is 
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that of Reynolds and Glaser (1964). Using an instructional program to 
teach ten topics in biology, Reynolds and Glaser inserted frames containing 
half as many repetitions of technical terms in one case and one and one- 
half times as many repetitions in another as those in the original groups. 
After three weeks, the retention of these items was measured. The investi- 
gators v/ere unable to find any differences in retention as related to the 
amount of repetition. Similarly, Chierpilowski (1971), Dopra (1973), and 
Boyd (1973), found no evidence that delayed retention was increased as a 
result of an 'ncreased number of practice trials. 

fiuch of the research on practice and retention of intellectual 
skills has also failed to indicate any differences in retention attributable 
to nuiAer of practice trials. Shuster and Pigge (1964), while not directly 
assessing the effects of different numbers of practice trials did investi- 
gate amount of class time spent osr practice versus that spent on develop- 
mental activities. The term developmental activities v/as used to refer to 
those activities of the teacher and class intended to increase understand- 
ing of the number system, the fundamental processes, and the general 
usefulness of number and quantity in everyday experience. Their findings 
suggest that long and extensive sessions with practice on exercises is 
not desirable. Studies comparing class time spent on practice with that 
spent on developmental activities were also conducted by Shipp and Deer 
(1960) and Zohn (1966). Findings tend to agree that more than 50% of 
class time should be spent on developmental activities. 

In two experiments conducted by Bassler, Curry, Hall, and tiealy 
(1971), the variable of number of practice examples was investigated. 
Seventh grade students received instruction on a hierarchically designed 
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roathematlcal task and practiced each skill either 1, 3, or 5 tlines. Four 
weeks after original learning a retention test v^as adnlnlstered which 
required the students to be able to apply the rules previously learned. 
Results of this first experiment Indicated very low performance on both 
achievement and retention measures and did not find any differences in 
achievement or retention scores among groups. The second experiment was 
a replication of the first, using subjects of above average I.Q. Although 
overall performance in this experiment v/as higher, the retention test 
again indicated no differences in scores among groups. 

Hannura (1973) studied the effects of cuss, and different conditions 
p>f learning, one of vihich v/as overleaming, upon the retention of three 
rales in electricity. The overleaming mk determined by tlie number of 
problems which were to be correctly v/orked before a student was assumed 
to have learned the material and reached criterion performance. In this 
case, the overleaming was five versus tt/o correctly i/orked problems 
for each rule. Retention was measured after seven doys^ and once again, 
results indicated no difference beti/aen scores for the different practice 
groups. 

A study conducted by Gagne. \ayot> Gars tens, and Paradise (1962) 
also failed to find. evidence of the effectiveness of additional practice 
for learning and retention. In this stwiy, a group of seventh grade 
students were taught the addition of integers « and one group received 
four or five times as many practices in each of the subordinate skills 
as did another group, yet no difference was found in final performance. 
Similar results vmre obtained by Gagne (19G5), Gagne and Sassier (1963), 
and Gibson (1969). 
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As was noted at the beginning of this review., the potential sig- 
nificance of niiTiber of practice trials for learning and retention Is 
great, but the amount of research which has been done In this area is 
quite limited. Research results which are available still leave many 
questions to be ansvifered. Evidence regarding the value of practice 
for Information learning is contradictory and many who. do find Increased 
retention also find a leveling off point after v/hich Increased practice 
}7«s ,-^0 effect. Relevant research In the area of learning and retention 
cf Intellectual skills is even more limited. Results of tlie studies 
which have been reviewed Indicate no difference In retention scores as 
related to number of practice trials directly following original learning. 

Delayed Practice 

\\ore research has been conducted in the area of spaced review 
than on the variables of number of practice trials^ and the results have 
been much more consistent. In verbal learning, for example, the evidence 
strongly Indicates that delayed reviei-/ significantly enhances delayed 
retention. 

One such piece of evidence Is found In an experiment conducted by 
Peterson* Ellis, Toohilh and Kloess (1935) to determine the effects of 
delayed review on the retention of prose. One set of students received 
a revlev; one week after learning v/hlch consisted of a repetition of the 
conditions of origlral learning, while another group received no reviei/. 
Retention was then measured tv/o, three, six, and eighteen weeks after 
learning by retention tests which were written essay reproductions scored 
for Ideas. Results indicated that, on the whole, the effects of the 
review were large and relatively permanent. 
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A nunter of other studies (Spltzer, 1939> Spencer, 1941; Tiedman, 
1943; Ausubel and Youssef, 1965: Reynolds and Glaser, 19S4.: Gibson, 1965) 
have also demonstrated the effectiveness of delayed review on retention 
of meaningful material. 

Although relevant research In the domain of intellectual skills 
is extremely 11ml teds an experiment conducted by Gay (li)73) reports findings 
consistent with those previously noted for meaningful verbal learning. 
Gay (1973) compared tlie relative effectiveness of a single revia-/ placed 
one day, one week, or txio v/eeks after original learning. A fourth group 
received no additional practice follm^lng original learning. The students 
learned four mathematical rules utilizing varying numbers of examples, 
all learning to a common criterion of teio consecutive correct problems. 
Three weeks from the day of original leartitng a delayed retention measure 
on the four mathematical rules v/as administered to each of the four groups. 
While all reviet/ groups retained considerably more than the no revio/ group, 
temporal position v/as not significant as a variable. 

In the domains of both verbal information and intellectual skills, 
findings are consistent v/ith regard to the effect of delayed review in 
enhancing retention. These findings are consistent over many types of 
reviev;. Including, rereading, test, practice^ and relearning to criterion, 
as well as over different types of retention measures, Including multiple 
choice, recall and construction essay tests. It is also interesting to 
note that Ausubel (1966) and Gay (1973), while finding increased reten- 
tion, did not find temporal position of review to be significant. 
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PURPOSE AllD RATIOtJALE FOR THE STUDY 

As previously noted, there is not a great deal of research 
Investigating the relationship bett^en number of practices and delayed 
retention. One Important consideration Is either an Increased number 
of practice trials directly following Initial learning ijicreases delayed 
retention. Itost of t!ie research v/hlch has been conducted on this question 
has bsen In the domain of Information or verbal learning, and here the 
evidence Is Inconclusive. Verbal learning Is of unquestionable Importance 
In a student's education, but it should be remembered that a large r'^rt of 
what Is learned In the schools comprises Intellectual skills. Including 
rules. Available research on this aspect of the problem Is limited, 
although evidence Is somevihat more consistent than that for Information. 
Indications are that once a rule or concept has been learned, as demon- 
strated by reaching a pre-established criterion^ any further practice at 
the time of original learning does not have an appreciable effect on 
delayed retention. 

These findings suggest anotlier question about the relationship of , 
practice to retention of Intellectual skills. If practice beyond the 
criterion performance at time of original learning does not aid retention, 
i^at Is tlie effect of practice at some period after original learning? 

Research on thiis question Is even more limited, but again. Indi- 
cations are fairly consistent. It appears that this delayed practice, 
v/lthout consideration to number of practices or temporal position, 
significantly enhances retention. . ■ 
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The present studly v/ill furtlier investigate these two aspects 
of the relationship beti/een practice and performance on a delayed 
retention measure of rule learning. The follov/ing additional ifnpli- 
cations of these findings will also be explored: number of practice 
trials has previously been investigated for its effect at a time 
directly follov/ing original learning, but little is knam about the 
possible implications of the^e findings for number of practice trials 
at a time after the occasion v/hich includes original learning. Effect 
of number of practice triads at a delayed time will, therefore, also 
be investigated. Also, delayed practice, v/hich has previously been 
compared for effectiv'^ne:>s only witli no practice, will, in the present 
study, be compared v/ith immediate practice as well. 

For purposes of this study, a practice trial will consist of 
•working a problem demonstrating a previously learned mathematical rulej 
immediate practice will be defined as practice immediately follov/ing 
learning to criterion at original learning; and delayed practice will 
be defined as practice on the fifth day following original learning. 
It should also be noted here tint a criterion problem will be utilized 
in each case to determine if the student has learned the rules involved. 
Tabard this end, reaching criterion will consist of demonstrating the 
ability to apply the rule to a novel example by v/orking one problem 
correctly. It is hoped that this procedure will provide a tool for 
determining wlien a student has readied mastery of a rule. 

The primary purposes of the study v/ere to contrast the effects 
of immediate practice (examples given directly follovnng learning) and 
delayed practice (examples given five days later) on retention of the 
rules measured after a longer interval (21 days). Itore specifically, 
the alms v/ere: . , 



11 

1. To determine whether number of iminediate practice trials 
beyond reaching criterion is effective for retention (21 days). 

2. To determine whether retention is affected by number of delayed 
practice trials.. 

3. To determine whether delayed practice is effective for 
retention. 

4. To determine the effects of delayed practice, as opposed to 
immediate practice, on retention. 

In addition to the primary purposes of this investigation listed 
above, a secondary purpose will be to determine the course of retention 
from the point of initial learning to 21 days later. 

i'lETHOD AUD PROCEDURE 

Experi menta 1 Desi gn . - 

The design utilized in this experiment is of the type referred 
to by Campbell and Stanley (1972) as a posttest only control group design. 
In this design. Group I (control) received no practice and Groups II through 
V (experimental) received one immediate, five immediate^ one delj^yed and 
five delciyed practice trials, respectively. It should be noted that 
practice v/as defined as problem(s) beyond reaching criterion, which meant 
vi/orking one problem correctly. Consequently, members of each group „ 
including the no practice group , worked one correct problem in reaching 
criterion which was not counted as a practice trial. The basic design 
is shov/n in Table 1. . 
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TABLE 1 

PLACEiEilT AND HUiiBER OF PRACTICE TRIALS A.UD RETEilTIOII TEST III 
THE FIVE GROUPS OF THE EXPERIMENT 



Group 


Following 
Learnino 


Day 5 


Day 21 


T 


<j practi c6 


0 practice 


Retention test 


II 


1 practice trial 
per skill 


0 practice 


Retention test 


III 


5 practice trials 
per skill 


0 practice 


Retention test 


IV 


0 practice 


1 practice trial 
per skill 


Retention test 


V 


0 practice 


5 practice trials 
per skill 


Retention test 



This design equates for all groups tlie interval between original 
learning and retention test rather than that between practice and retention 
test. Evidence implies that this is not a critical variable, and it is 
believed that both of these approaches would have yielded much the same 
results in terms of a comparison of retention test scores. Peterson 
et al (1935), Gay (1973), and Ausubel (1965) each examined the effective- 
ness of review, using different v^ays of counting the inter/al betveen 
learning and retention. Peterson and Gay used time from original learning 
as the retention interval / whereas Ausubel used time from review. The 
results obtained in each of these studies were very similar. It is also 
a consideration that scores for retention after intervals of t/o weeks or 
more are unlikely to be affected greatly by differences of a few days in 
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the designation of the- "retention interval." This is true because of 
the general finding of the leveling off of retention losses beyond t/o 
v/eeks (Gay, 1973). 

Materials 

In order to investigate the effects of the independent variables, 
three rules of combining exponents with the same number bases v/ere chosen 
to be taught to a group of seventh grade students. These rules were (1) 
multiplying numbers v/hich are v/ritten in exponential notation and have 
the same number base, e.g-j 2^ x 2^ = 2^, (2) dividing numbers which are 
written in exponential notation and have the same number base, e.g.^ 
|g '= 2^: and, (3) raising numbers v/ritten in exponential notation to a 
pov;er;> e.g., (2^)^ = 2^. Selection of these particular rules v/as made 
largely on the basis that they v/ere rules not previously encountered by 
seventh grade students. It v/as also of importance that entry behavior 
requirements for these rules involved only the basic skills of adding, 
subtracting and multiplying, and the skills of v/riting factors in 
exponential notation and reducing fractions. These latter skills were 
easily reviev/ed or taught by the classroom teacher, prior to the first 
day of the experiment. 

To provide instruction in the three rules, a programmed text^ 
designed to be administered in a classroom situation v/ith teacher assis- 
tance, was written. . The text was a fcventy-four frame, large step program 
in four sections. Frames 1-5 were a review of writing factors in 
exponential notation; frames 5-11 v/ere instructions on multiplying 
numbers which are written in exponential notation; frames 12-17 v/ere 
instructions on dividing numbers which are v/ritten in exponential 
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notation, and frames 10-24 were instructions for raising numbers v/ritten 
in exponential notation to a power. Each instructional sequence within 
the programmed instruction was constructed using t\\Qi following steps for 
rule learning, as suggested by Gagne (1970): 

Step 1 ; Inform the learner about the form of the performance to be 

expected v/hen learning is complGted. 
Step 2 : Question the learner in a way that requires the reinstatement 

of the previously learned concepts that make up the rule. 
Step 3 : Use statements that will lead the learner to put the rule 

together^ as a chain of concepts, in the proper order. 
Step 4 : By means of a question, ask the learner to "demonstrate" 
one or more concrete instances of the rule. 
At the end of each section in the programmed text a criterion problem, for 
which the ansv/er v/as not given, vias included (this corresponds to Step 4 
above). 

Also developed v/ere sets of one and five practice problems for each 
of the three skills. For the students in the tm groups receiving immediate 
practice, a separate page containing the appropriate number of practice 
problems v/as inserted following the criterion problem in each section. 
These same practice problems were also administered to the tv/o groups 
receiving delayed practice. 

Subjects 

Subjects v;ere the students of one seventh grade mathematics teacher 
at Griffin Hiddle School in Tallahassee j> Florida. It v/as determined 
beforehand that students in mathematics classes at Griffin School are not 
grouped according to ability. A wide range of ability levels could 
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therefore be expected to be present among the subjects. These students 
v^ere particularly well suited to work v;ith a progranmed text involving 
limited teacher assistance, since their normal classroom routine includes 
a great deal of individual work. 

The 134 subjects involved were randomly assigned to the five 
treatment groups. Eighteen students ^ who wero absent on the day of 
original learning or on the day of the retention test v/ere eliminated 
from the sample. An additional 13 students who either failed to reach 
criterion for any of the three skills, or v;ho did not complete the 
programmed text in the allotted time^ were also eliminated from the 
sample. This resulted in a total sample size of 103 with the represen- 
tation of each group as follows: 27, no practice; 20, one immediate 
practice trial j 18, five immediate practice trials; IG, one delayed 
practice trial; and 20, five delayed practice trials. 

Procedure 

Administration of the programmed text was carried out during the 
students' math period by the regular classroom teacher and a student 
intern who had been working with her. In order that the time interval 
between original learning and delayed practice vrauld include a period 
of non-school activity, the text was administered on Wednesday, when 
Thursday and Friday v«re to be school holidays. The ti70 delayed 
practice groups then received their practice trials the following ilonday. 

On the day of original learning programmed texts were distributed 
according to the random assignment of students to t!ie five treatment groups. 
Tlie classroom teacher then read through directions for v^orking the 



19 



IG 

instructional material with the students. Students Mere instructed to 
proceed viith the prograinmed text by v/orking each frame> writing their 
answer, and checking it against the correct ansv/er v/hich was given in 
the lower right hand corner of each frame* If their answer was 1ncorrecti> 
they Mere to do enough work to see ivhy the ansv^er given v/as corrects and 
If they still did not understand, they v;are to request help from the 
teacher » In this manner^ students v/ere to liork each section of the text 
and raise a hand after completing the criterion problem, for v/hich the 
answer was not provided, so that their ansv/er could be checked. Either 
the teacher or the intern then checked the student's ansv/er to the cri- 
terion problem. If the ansv/er was correct (indicating that the criterion 
had been reached for the skill involved) the student v/as Instructed to 
turn the page and begin the next section. Teacher and intern had pre- 
viously been provided with an alternate criterion problem for each of 
the three skills. If a student had ansv/ered a criterion problem Incor-* 
rectly:> he v/as told the correct answer and given the alternate problem 
to provide him a second opportunity to reach criterion. If this problem 
was not ansv/ered correctly it v/as so indicated on the text, and the 
student was later eliminated from the sample, although he was Instructed 
to turn to the next section and alloifed to complete the Instructional 
material. As students completed the programmed text. It v/as collected 
immediately and the students were assigned v/ork typical of their normal 
classroom routine. This v/as done in order to prevent them from looking 
back through the text or rehearsing the material after the text had been 
collected. 



20 



17 

The one no practice group and the to/o delayed practice groups 
followed the above procedure throughout the administering of the programmed 
instruction. The two groups receiving immedlatG practice trials followed 
the same procedure, with tlie exception of the inclusion of eitlier one or 
five practice problems on a separate page immadiately following each 
criterion problem. In these instances, after a student's criterion 
problem was checked he was instructed to turn to the next page, where 
he worked the practice problem(s), and raised his hand to have his 
ansv/er(s) checked. After the practice problem(s) had been checked, 
the student was given only the correct ansv7er(s) for the problem(s) he 
had missed and instructed to turn the page and begin v/ork on the next 
section. 

Practice problems were distributed on the following ftonday. to 
the ti/o delayed practi groups. These students received a page con- 
taining either one or five practice problems per skill, or a total of 
either three or fifteen problems. As with the immediate practice groups, 
subjects in these groups were instructed to raise a hand after com- 
pleting the practice problems, their answers were checked and the 
correct answers given. Again, no additional Information was provided. 
During the time delayed practice trials were being administered to these 
groups, the remainder of the students continued to work on individual 
classroom projects v/hich the teacher had previously assigned. 

Retention Test 

Three weeks from the day of original learning tlie retention test 
V/9S administered, fhis test was developed by constructing a nine-item 
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pool for each of the three skills to bs tested and randomly selecting four 
problems from each. In this way, a tv/elve-item retention test was con- 
structed, consisting of three sections, one for each skill to be tested, 
with students receiving a separate score for each skill. Consequently, 
there were three depend3nt measures for each student, one for each skill 
he had learned. The remaining five items of each item pool were used as 
the practice problems, with the first of each set of five being used for 
toe groups having one practice trial. 

RESULTS 

Retention Scores 

Three weeks following original learning a delayed retention 
measure was administered. The measure used v«s a test consisting of 
twelve problems, four for each of the three skills. Scores for each of 
the skills were considered individually. 

Table 2 gives a breakdown of retention test scores by number of 
students working G, 1, 2, 3, or 4 correct problems for each skill. 

A review of the scores in Table 2 reveals that only one subject 
scored two correct problems for a skill. With 103 subjects participating 
and being testae! on three skills, this means that a score of two correct 
problems was made only one time in 309 opportunities. This finding and 
the clustering of scores at 0 or 1 and 3 or 4 correct problems would 
clearly seem to indicate that a student either had mastered and could 
apply the skill, or had net. For this reason, the scoring procedure 
selected was that of accepting a score of 0 or 1 to indicate a student 
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TABLE 2 

RETENTION TEST SCORES BY SKILL 



Number of 
Students 

80 

75 

70 

6S 

60 

55 

50 

45 

40 

35 

30 

25 

20 

15 

10 

5 

0 



Skill 1 



Number of Correct Responses 



Skill 2 



Skill 3 



Jzi 



t — 1 f 



0 12 3 4 



0 12 3 4 



0 12 3 4 
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could not perform the skill and a score of 3 or 4 to indicate he could 
perform the skill. Each student then received a score of either 0, 1, 2, 
or 3 for the number of skills he could correctly apply. 

Utilizing this scoring procedure, the means and standard deviations 
for the total scores of the five treatment groups were calculated and are 
Shown in Table 3. 



TABLE 3 

MEANS AMD STANDARD DEVIATIONS OF THE FIVE TREATMENT GROUPS 



Group 




Mean 


Standard 
Deviation 


I . 


(no practice) 


.93 


1.00 


II 


(1 immediate practice trial) 


.45 


.60 


III 


(5 immediate practice trials) 


.56 


.62 


IV 


(1 delayed practice trial) 


1.00 


1.00 


V 


(5 delayed practice trials) 


1.25 


.85 



Table 4 gives a breakdown of practice trial scores by number of 
students in the five immediate and five delayed practice trial groups 
working 0, 1, 2, 3, 4, or 5 correct problems for each skill. 
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TAJLE 4 

PRACTICE TRIAL SCORES BY SKILL 



Wuniber of Correct Responses 
Skin 1 Skill 2 Skill 3 





0 


1 


2 


3 


4 


5 


0 


1 


■ 2 


3 

0 ' 


4 


5 


0 


1 


2 


3 


4 


5 


Inmediate 






































Number of 
Students 


0 


0 


1 


0 


1 


15 


0 


0 


0 


0 


2 


16 


0 


0 


0 


0 


1 


17 


Delayed 






































Number of 
Students 


10 


0 


0 


0 


2 


8 


.11 


0 


0 


0 


0 


9 


13 


0 


0 


0 


0 


7 



Tests of Hypotheses 

The total number cf subjects v/as 103 and of this number, 45 subjects 
received scores of 0, 34^ scores ©f 1, 19, scores of Z, and 5^ scores of 3. 
In view of the nature of these scores. It appeared that non-paparetric methods 
of data analysis v/ould be most appropriate. Since the scores could be vieived 
as ordinal measures, lillcoxon rank-test v/as utilized for palnnse comparison 
and Kruskal -Wallace was utilized for one-v/ay analysis of variance tests. Each 
null hypothesis was tested at the « = .05 level. 

Effects of Immediate practice trials . In order to determine whether 
number of Immediate practice trials beyond criterion is effective for retention 
(21 days) the folloidng null hypothesis was tested: 

Ho: Group 1 * Group 2 = Group 3 (There is no difference among the 
distribution of the scores of the group receiving no additional practice trials. 



22 

the group receiving 1 additional immediate practice trial and the group 
receiving 5 additional Immediate practice trials.) The probability of this 
occurrence under the null hypothesis was found to be greater than .05/ 
therefore, the null hypothesis was not rejected. In other words, immediate 
practice trials, as fev; as one or as many as five, are not found to have 
significant effects on retention scores. 

Effect of number of delayed practice trials . In order to determine 
whether retention is affected by number of delayed practice trials, the 
following null hypothesis was tested: 

Ho: Group 4 = Group 5 (There is no difference betv/een the distribution 
of the scores of the group receiving 1 dela(yed practice trial and 
the group receiving five delayed practice trials,) 
The probability obtained under the null hypothesis was greater than •OS and 
the null hypothesis was not rejected. As a result of this analysis, it would 
appear that number of practice trials at a delayed time is not significantly 
effective for delayed retention. 

Effect of delayed practice trials . In order to determine whether 
delayed practice Is effective for retention, the following null hypothesis 
was tested: 

Ho: Group 1, 2, and 3 = Group 4 and 5 (There is no difference 
betiveen the distribution of the scores of the group composed 
of those receiving no additional practice trials, or 1 or 5 
additional immediate practice trials and the group composed 
of those receiving 1 or 5 additional delayed practice trials.) 

This hypothesis (normal approximately - 2.53^ p < .05) was found to 
have a probability of occurrence under the null hypothesis of less than .05 
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and was therefore rejected. This result indicates that delayed practice as 
compared to no practice and one or five immediate practice trials is effec- 
tive in enhancing delayed retention. 

Effect of del ajyed vs . immedi ate practi ce tri al s . The fourth null 
hypothesis to ^^xamined was designed to determine the effect of delayed 
practice trials aa opposed to immediate practice trials on retention. 
This hypothesis was as follows: 

Ho: Group 4 and 5 = Group 1 and 2 (There is no difference 
between the distribution of the scores of the group com- 
posed of those receiving 1 or 5 additional immediate 
practice trials and the group composed of those receiving 
1 or 5 additional delayed practice trials. 
This hypothesis (normal approximation = 3.05, p < .05) v/as found to have 
a probability of occurrence under the null hypothesis of less than .05 
and was therefore rejected. This result indicates that delayed practice 
trials are more effective than immediate practice trials for delayed 
retention (21 days). 

Curve of Forgetting 

To determine the course of retention from point of original learning 
to 21 days without the influence of additional practice trials, three 
retention curves (one for each of the three skills) were plotted. The first 
measure of retention utilized the practice trial scores of the five immediate 
practice group. The second measure of retention was made on the fifth day 
after original learning by using the scores of group five (five delayed 
practice trials) on the practice trials they received for each skill. 
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A final measure v>fas obtained by utilizing the scores of group one (no 
practice) for the delayed retention measure (21 days). 

These curves of forgetting may be found in Figure 1. 



FIGURE 1 
CURVES OF FORGETTING BY SKILL 
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As can be seen from this figure, retention was virtually 100% 
immediately following original learning, but dropped to approximately 
40% on day five. An additional, but less substantial drop in retention 
was experienced betveen day five and day 21, with scores of the delayed 
retel^^t1on measure indicating a retention of approximately 30%. In 
general, total retention loss was quite high, and t!ie greatest losses 
occurred within the first five days following original learning. 
Retention loss appears to have leveled off somev/hat, however, between 
delayed practice on day five and delayed retention measure on day 21. 

DISCUSSIOiJ 

The present study was designed to answer several questions 
regarding the relationships of number of practice trials and immediate 
and delayed practice trials to the delayed retention of rule learning. 
Examination of the retention test scores failed to reveal a significant 
effect on delayed retention for number of immediate practice trials 
when compared with a group receiving no practice. Scores for the 
delayed practice groups, 1 receiving 1 and 1 receiving 5 practice trials, 
were also examined in an effort to determine the effectiveness of number 
of delayed practice trials for delayed retention. Again:, no significant 
difference v/as revealed. 

A significant difference in effectiveness of delayed practice 
trials for delayed r'etention was revealed when scores of the group com- 
posed of the one and five delayed practice groups were compared with 
scores of the group composed of the no practice and 1 and 5 immediate 
.practice groups. A comparison of the effectiveness of immediate and 
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delayed practice trials also revealed a significant difference in delayed 
retention scores in favor of delayed practice. 

The finding of no significant effect on delayed retention for 
number of iminediate practice trials is in agreement with findings of 
earlier studies investigating number of practice trials and intellectual 
skills (Dassler et al, 1971, Hannum, 1973. Gagne et al, 1962, Gagne, 1965; 
Gagne & Bassler, 1965. Gibson, 1969). Since an important aspect of this 
investigation was that all subjects learned the material to the same 
preestablished criterion of working one correct criterion problem for 
each skill, these findings provide additional support for the position 
that additional practice trials beyond mastery appear to have no signifi- 
cant effect on delayed retention of intellectual skills (Gagne, 19/0). 

lihile there appears to be no previous literature examining tlie 
effectiveness of number of practice trials at a time after original 
learning, the finding of no significant difference in the effectiveness 
of one and five delayed practice trials was not unexpected. Existing 
research on effectiveness of number of practice trials for delayed reten- 
tion of intellectual skills has been conducted with practice trials at 
time of original learning and most has found no significant differences. 
Fr^m these findings one might expect, as was the case in this study, that 
number of practice trials at a delayed time would also not prove signifi- 
cant in its effect on delayed retention. 

The significant difference in scores between the group composed 
of 1 and 5 immediate practice groups and the no practice group and tlie 
group composed of the 1 and 5 delayed practice groups, as well as that 
between a comparison of just immediate and delayed practice groups is 
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consistent with implications of earlier research on intellectual skills. 
Uhile no research appears to* have been performed to investigate these 
specific relationships, studies of tivo related questions would suggest 
these findings, flumber of practice trials beyond mastery (immediate 
practice) has not been shown to be effective for delayed retention and 
delayed practice has been shown to be effective in improving delayed 
retention when compared with no practice. 

Implications 

Various research studies cited in earlier sections of this paper 
found high rates of forgetting by students of material learned in the 
class rooir^. This research dealt with various types of learning outcomes, 
both verbal and intellectual. The results of the present s'tudya which 
investigated retention of three clearly defined mathematical rules are 
no different in this respect than those of earlier investigations. From 
a demonstrated retention of nearly 100% iiranediately following original 
learning, subjects in this stuc(y showed a retention of only 40% after 
just five days and 30% after 21 days* Forgetting of these skills was 
substantial . 

Retention measure scores for each student suggest some additional 
information concerning the learning and forgetting of Intellectual skills. 
Clustering of retention measure scores for each skill at either high or 
low scores with very few of inbetween value has previously been mentioned. 
When a clearly defined skill is taught and its mastery and retention are 
measured in a way which unambiguously represents that skill, these results 
imply that the skill is either accessible or non-accessible. The outcome 
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of instruction designed to teach specific skill and the attainment of 
that skill may best be considered not in terms of ar\y'degree of learning, 
but as learned or not learned, i.e., mastered or not mastered. 

Another implication suggested by the findings of this study is 
that learning to a set criterion of performance could be a very important 
key to the learning and retention of intellectual skills. This study in 
examining immediate practice has found no significant effect on delayed 
retention of mathematical skills for practice trials beyond mastery. 
Hannum (1973) obtained similar results in an investigation of the reten- 
tion of rules in electricity. Gay (1973) found that increased retention 
resulted from having subjects relearn to criterion at a time after 
original learning. Perhaps the factor which should be given more con- 
sideration then is not number of practice trials » even at a delayed time, 
but rather the requirement that a student laarn to a mastery criterion,. 

Results of this study do not show improved retention of intellec- 
tual skills to resuU from additional practice. This result contrasts 
with that obtained for other areas of learning, particularly verbal 
learning. The present findings are of importance for the learning and 
retention of intellectual skills. They suggest a vew role for number of 
practice trials and delayed practice as aids to del oyed retention. Addi- 
tional practice trials maiy have their effects in tt>rvi5 of amount of 
practice necessary to reach mastery, rather than as ivumber of practice 
trials beyond criterion ("overlearning") . Delayed practice is presumably 
more effective than immediate practice because it serves as a source of 
cues to retrieval of the desired skill. If the intent is to improve retention 
the suggestion is to search for other ways of cueing retention and retrieval. 
Practice which includes relearning to criterion may offer one possibility. 



•1 



29 



REFERENCES 



Anderson, R.C. and G.ll. Faust. Educational Psychology: The Science of In- 
struction and Learning . Mew York: Dodd, Mead & Co., 1973. 

Ausubel, D.P. Early versus delayed review in meaningful learning. 
Psychology In The Schools , 1966, 3, 195-198. 

Educational Psychology: A Cognitive View . Mew York : Hoi t , 
Rinehart and Winston, Inc., 1968. 

Ausubel, D.P., and M. Youssef. The effect of spaced repetition on meaning- 
ful retention. The Journal of General Psychology , 1965, 73, 147-150. 

Bassler, O.C., D. Curry, W. Hall, and E. Mealy. An investigation of two 
instructional variables in learning nonmetric geometry. School 
Science and Mathematics , 1971, TJ., 441-450. 

Boyd, W.fl. Repeating questions in prose learning. Journal of Educational 
Psychology , 1973, 64, 31-38. 

Briggs, L.J. and H.B. Reed. The curve of retention for substance material. 
Journal of Experimental Psychology , 1943, 32, 513-517. 

Campbell, D.T. and J.C. Stanley. Experimental and Quasi-Experimental 
Designs for Research . Chicago: Rand f^cMally and Company, 1972. 

Chierpilov/ski , G. Effects of repetition, total time of review, and student 
retention level on the relearning and delayed retention of facts. 
Dissertation Abstracts^ International . 1971, 32A, 301A. 

Craig, C.S., B. Sternthal , and K. Olshan. The effect of overlearning on 
retention. The Journal of General Psychology , 1972, 87, 85-94. 

Dopra, R.A. The effects of advance organizers, post-questions, and repeti- 
tion on the learning and retention of prose materials in high and Ipv/ 
verbal ability subjects. Dissertation Abstracts International , 1973, 
33A, 6725-A. ; " ^ 

English, H.P., E.L. ^/^elborn, and CD. Killlan. Studies In Substance . 
memorization. Journal of General Psychology , 1934, jn_, 233-260. 

Freud, H., and f!.D. Cheronis. Retention in the physical science survey 
course. Journal of Chemical Education , 1940, 17^, 289-293. 

Gaqne, R.M. The Conditions of Learning , New York: Holt, Rinehart and 
Winston* Inc.^' 1970. ^ 

: Domains of learning. Interchange , 1972, 2» l-S- 



EKLC 



33 



30 



Gagne, R.M. and O.C. Bassler. Study of retention of some topics of 

elementary nonmetric geometry. Journal of Educational Psychology, 
1963, 54(3), 123-131. 

Gagne, R.M. and Staff, University of Maryland Mathematics Project. Some 
factors in learning nonmetric geometry, Monographs of Society for 
Research in Child Development , 1965, 30, 42-49. 

Gagne, R.M., J.R. Mayor, H.L. Garstens, and f!.E. Paradise* Factors in 

acquiring knowledge of a mathematical task. Psychological Monographs , 
1962, 76^ 7(v/hole number 526). 

Gay, L.R. Temporal position of reviews arid its effect on the retention of 
mathematical rules. Journal of Educational Psychology, 1973, 64, 
171-182. ~ 

Gibson, J.R. Transfer effects of practice variety in principle learning. 
Unpublished Dissertation, University of California, Berkeley, 1969. 

Gibson, J.T. The effects on retention of programmed classroom reviev/s. 
The Journal of Educational Research , 1965, 58(10), 449-452. 

Gilbert, T.F. Overlearni .g and the retention of meaningful prose. Journal 
of General Psychology , 1957, 56, 281-289. 

Hannum, W.H., Jr. A study bf select factors influencing the retention of 
rules. Unpublished Ph.D. Dissertation, Florida State University, 
Tallahassee, 1973. 

Lahey, Sister ilF. Permanence of retention of first year algebra. 
Journal of Educatiohal Psychology , 1941, 32(6), 401-413. 

Layton, EiT» The perslstl^hce of learnfhg fM elementary algebra. 
Journal of Educational PsychdloqVt . 1 932 , 23 , 46-55 . 

McTavish, t;L'., i Effect of ir6|3et1ti\/e fllhi sHbwing oil Ijearning, Technical 
report 5DC. 269-^^-12, Iristructiortdl film research t!rogt*am, Pennsyl- 
vania State Collegfe. Port Wa$hirigtdrt> fleW York* Special Device 
Center, 1949. Reported in AUsubel (1968): 

Peterson, H.A., M. Ellis, H, Toohill and P, Kloess. Sonte mfeaatlrdmentfe of 
the effects of reviews. Journal of Educational Psychology , 1935, 
26, 65-72. 

Pressey, S.L., F.P. Robinson, and J.E. HorrpckSy Psychology in Education . 
New York: Mafper & Row, publishers. Inc., 1959, 

Reynolds, J.H., and R. Glaser, Effects of repetition and spaced review 
upon retention of a complex learning task. Journal of Educational 
Psychology , 1964, 55(5), 297-308. 



34 



31 

Rothkopf, E.Z. Textual constraint as a function of repeated inspection. 
Journal of Educational Psychology , 1968, 59, 20-25. 

Schuster, A.H., and F.L. Piqqe. Retention of meaninqful teaching. The 
Arithmetic Teacher , 1965, 12., 24-31. 

Shipp, D.E., and G.H. Deer. The use of class time in arithmetic. The 
Arithmetic Teacher , 1960, 7i, 117-121. 

Slamecka, M.J. Studies of retention of connected discourse. American 
Journal of Psychology , 1959, 72, 409-416. 

Spencer, E.M. The retention of orally presented materials. Journal of 
Educational Psychology , 1941, 32, 641-655. 

Spitzer, H.F. Studies in retention. Journal of Educational Psychology , 
1934, 30, 641-656. 

Sterrett, M.D., and R.A. Davis. The performance of school learning: A 

review of studies. Educational Administration and Supervision , 1954, 
40(8), 449-460. 

Tiedeman, H.R. A study of classroom learning. The Journal of Educational 
Research, 1948, 4i, 516-531. 

Tyler, R.W. What high school pupils forget. E ducational Research Bulletin . 
1930, 9, 490-492. 

. Permanence of learning. Journal of Higher Education , 1933, 4, 

203-204. 

Zohn, K.G. Use of class time in eighth grade arithmetic. The Arithmetic 
Teacher, 1966, 13, 113-120. ' 



